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Abstract 

The log-periodic power law (LPPL) is a model of asset prices during endogenous bubbles. 
A major open issue is to verify the presence of LPPL in price sequences and to estimate the 
LPPL parameters. Estimation is complicated by the fact that daily LPPL returns are typically 
orders of magnitude smaller than measured price returns, suggesting that noise obscures the 
underlying LPPL dynamics. However, if noise is mean-reverting, it would quickly cancel out 
over subsequent measurements. In this paper, we attempt to reject mean-reverting noise from 
price sequences by exploiting frequency-domain properties of LPPL and of mean reversion. First, 
we calculate the spectrum of mean-reverting Ornstein-Uhlenbeck noise and devise estimators for 
the noise's parameters. Then, we derive the LPPL spectrum by breaking it down into its two 
main characteristics of power law and of log-periodicity We compare price spectra with noise 
spectra during historical bubbles. In general, noise was strong also at low frequencies and, even 
if LPPL underlied price dynamics, LPPL would be obscured by noise. 



1 Introduction 

Financial bubbles and busts have devastating effect on the economy and on markets. However, 
the existence and characteristics of bubbles are notoriously hard to ascertain if not with hind- 
sight. This paper contributes to the investigation of financial bubbles within the LPPL frame- 
work |Sornette, 2 004 1, and specifically it examines its frequency-domain properties under a mean- 
reverting noise model. 

Endogenous financial bubbles have been modeled as a log-periodic power law (LPPL ) |Sornett~2 004 
The LPPL model has two main characteristics: 

• Super-exponential growth, leading to a critical time at which the asset price will burst (power 
law), and 

• Oscillations that become progressively faster as the critical time approaches (log-periodicity). 

Super-exponential growth is a sign that price growth is unsustainable. The oscillatory behavior 
indicates an incipient system failure, and is often associated with increasingly more rapid and 
pronounced swings in investor sentiment |Stauffer and Sornette, 1998 . 
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Previous work has paid considerable attention to fitting the LPPL law to historical time series 



of financial bubbles, and a recent summary reviews the state of the art Jiang et al., 2010 . Current 



methods for LPPL bubble detection have been tested in an on-line experiment |Sornette et al., 2 009 1 . 
Previous work mostly focus on the two related issues of statistical significance and of noise in the 
data. The LPPL model parameters can be fit to the price sequences via non-linear least-squares 
| Jiang et al., 2010] , and we have previously proposed efficient parallel algorithms for least-square 
fitting |Liberatore, 2010 . The least-square algorithm returns an estimate for the LPPL parameters 



as well as a residual error. However, least squares always estimate parameters for the LPPL model, 
regardless of whether LPPL underlies actual price dynamics or not. The least square residual er- 
ror gives a sense of the presence of LPPL: if the final mean squared error is significantly smaller 
than the error at the beginning of the numerical fit, then there is some evidence for an underlying 
LPPL process. However, reliance on mean squared errors can produce spuriously high goodness 
of fit | Granger and Newbold, 1974, Phillips, 1986| . Although LPPL is often visible intuitively in 
price series and non-linear least squares substantially reduce the mean squared error over an initial 
exponential fit, the log-periodic component of the S&P 500 is not statistically significant prior 
to the 1987 crash if the last year of data is removed [Feigenbaum, 2001 . Furthermore, Bayesian 
methods fundamentally reject the hypothesis that LPPL underlies price dynamics during a bubble 
|Chang and Feigenbaum, 2006| . An alternative approach is to verify the non- linear least squares 
using unrelated tests, such as bounding the range of acceptable LPPL parameters or using a Lomb 



transform Jiang et al., 2010 . However, log-periodic variations prior to large drawdowns fail to 
satisfy the parameter restrictions in the LPPL model |Chang and Feigenbaum, 2008 1. 

In fitting LPPL to prices, the fundamental problem is that the daily LPPL returns are typically 
orders of magnitude smaller than the measured price returns. In other words, a hypothetical LPPL 
signal would be swamped by overwhelming noise, and thus it is difficult to ascertain its presence 
and its parameter values. Furthermore, it is also possible that the noise variance increases over 
time, in which case the observed prices tend to progressively differ more significantly from an 
underlying deterministic LPPL. When noise variance increases, the noise effectively becomes the 
signal. As such, LPPL estimation is plagued by a low signal-to-noise ratio, which additionally 
may be decreasing over time. However, an LPPL model with mean-reverting noise (e.g., Ornstein- 
Uhlenbeck) has been recently proposed |Lin et al., 2009| . If noise is mean-reverting, it has bounded 
variance, and thus the measured prices fits more tightly around the underlying LPPL. Furthermore, 
although a mean-reverting process may be characterized by large daily return, the daily gyrations 
will rapidly cancel each other out. In other words, mean-reverting noise is characterized by relatively 
low power at low frequencies. Thus, mean-reversion would make it possible to reconstruct the 
underlying LPPL by focusing on the lower frequency components of measured prices. 

In this paper, we examine LPPL with mean-reverting Ornstein-Uhlenbeck noise in the frequency 
domain. The paper investigates the mean-reverting properties of the noise, and whether the de- 
noised power spectrum shows a deterministic LPPL signature. Section [2] describes the LPPL model. 
Section [3] gives the necessary background on Ornstein-Uhlenbeck processes, analyzes its spectrum, 
and discusses two methods for estimating its parameters. Section [4] gives our methodology for 
calculating spectra of finite price sequences. Section [5] discusses the LPPL spectrum by breaking 
it down into its two main features of power law and log-periodicity. Section [6] discusses noise 
rejection in noisy LPPL price sequences. Section [7] evaluates the approach on major historical 
bubbles. Section M concludes the paper and outlines possible future work. 
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Figure 1: Log-scale S&P 500 and an LPPL fit from July 2003 to June 2007. 

2 LPPL 

The log-periodic power law is a function: 

£{t) = A- B{T -t) m {l + Ccos{uj\n(T -t) + (^)) , (1) 

where B > and < m < 1. The LPPL function is a model for a sequence of price logarithms 
p(0),p(l), . . . ,p(n — 1) in the sense that p(i) = £(i) + v(i), where v(i) is random noise independent 
of I. If we assume that £{T) = A, the LPPL function £ is defined for t < T. In particular, since £ 
is a model for a finite sequence of prices, we will also restrict £ over t > 0. As matter of notational 
convention, we remark that we call price sequence and denote as p(0),p(l), . . . ,p(n — 1) what in 
reality is the natural logarithm of prices. The convention makes our notation more compact, but it 
should be kept in mind that, for example, our daily price returns are basically price ratios. Figure 
[T] shows the S&P 500 daily closing prices and a least squares LPPL fit for the four years between 
July 2003 and June 2007. If m = 1,C = 0, LPPL reduces to an exponential model of the price 
sequence. If m < 1, then LPPL grows super-exponentially until the critical time T. If C, u > 0, 
then LPPL exhibits oscillations that become progressively more frequent as t approaches the critical 
time. Since £ is a deterministic signal and v is a wide-sense stationary process independent of £, 
most properties of stationary signals can be applied |Pollock, 2001| . Since v is independent of £, 
\P(f)\ 2 = \L{f)\ 2 + S(f), where L(f) is the transform of £, P(f) is the transform of p, and S(f) is 
the noise power. 

3 Ornstein-Uhlenbeck Noise 
3.1 Background 

The Ornstein-Uhlenbeck process v{t) is the solution of the stochastic differential equation: 

v'(t) = -^ + aT(t) , 
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where T(t) is Gaussian white noise, r > is called the relaxation time, and a > is called the 
diffusion constant jBibbona et al., 2008 1. The Ornstein-Uhlenbeck process can be interpreted as 
white noise that has been filtered by a first-order system with cut-off frequency f c = 1/(2ttt) . When 
t — y oo, the Ornstein-Uhlenbeck process reduces to a Weiner process. As t -> co, Var[z/(i)] = a 2 r/2 
and Cav[u(t + h),v(t)] = a 2 Te~^ T /2 |Bibbona et al., 2008] . A Ornstein-Uhlenbeck process can 
be simulated by means of: 



v(t + 1) = Ht)e- 1/T + yj - e-^)u t , (2) 

where ut is a sample value of a normal random variable |Gillespie, 1991 . The stationary Ornstein- 
Uhlenbeck process can be simulated by using recurrence ^ starting from u(0) being the sample of 
a Gaussian random variable with variance equal to linn,_ 5 . 00 Varhv(i)] = o~ 2 t/2. 

3.2 Spectrum 

The two-sided power spectrum is defined for t — > co, is equal to |Wang and Uhlenbeck, 1945 1: 

and it is the same as that of a first-order low-pass filter with cut-off frequency f c . Since we will be 
dealing with sampled Ornstein-Uhlenbeck processes, it is also useful to derive the spectrum of the 
discrete-time Fourier transform. The transform of the auto-correlation function is 



° T -\h\/r-juh 




h=0 

where a = e _1//r . Since, it is known that for \r\ < 1 |Rade and Westergren, 199 9, eq. 13.2(29)] 

oo 



E 1-rcos/c 
r n cos(hk) = k 
1 - 2r cos k + r 2 

h=0 



we have that 

S(")= ~—[-l + 2 



a 2 r ( 1 — a cos a; \ o 2 t 1 — a 2 



1 — 2a cos uj + a? 1 2 1 — 2a cos u) + a 2 



In terms of frequency / = lj/(2tv), 



S(f) 



a 2 r 1 - a 2 



2 l-2acos(2vr/) + a 2 ' 

Figure [2] shows the power of the discrete-time Fourier transform S(f) and of the continuous Fourier 
transform T(f) for r = 5 and a = 1/5. The power spectra are similar except at the highest 
frequencies. At low frequencies, since a ~ 1 — 1/r and a 2 ~ 1 — 2/r, T(f ) ~ S(f) — c 2 /(l — a) 2 ~ 



a 2 r 2 . 
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Figure 2: Power spectrum of the Fourier and discrete-time Fourier transform for r = 5, a = 1/5. 



3.3 Ornstein-Uhlenbeck Estimation 

We now turn to the estimation of the parameters a and r in the Ornstein-Uhlenbeck noise. We will 
follow two approaches for parameter estimation. The first approach is based on the intuition that 
on short time frames the noise dominates the LPPL signal (e.g., |Chang and Fei gcnbaum, 2006 1 ) . 
Therefore, the noise parameters could be determined with high accuracy by looking at diffusion and 
mean reversal over short intervals, possibly corrected by a first-order trend estimate. The second 
approach is pessimistic: it assumes r — > oo and finds the largest value of a that is consistent with 
the observed signal. In other words, the pessimistic approach attempts to explain the observed 
signal as much as possible as Weiner noise. 



3.3.1 Maximum Likelihood 

High-frequency estimation is based on the assumption that over short time scales the signal is 
completely dominated by noise. In this case, £(t + 1) ~ £(t), and since p(t) = £(t) + v(t), we have 
that u(t + 1) - v(t) ~ p(t + 1) - p(t). 

Given a sequence of observations ^(0), ^(1), . . . , v(n — 1) of an Ornstein-Uhlenbeck process, the 
maximum likelihood estimates of r and a 2 are 

T = 1X1 — , 
^>xy 

& = Z T7T Z~{Syy ItlSxy + CL S X x) ) 

1 - a 2 n - 1 

where a = e" 1 ^, S xx = Y17=i 1/2 (* ~ x )' S *v = YliZl v{i - l)v{i), and S yy = Yh=i 
|van den Berg, 20 07 ■ Maximum likelihood estimation is an estimation technique that operates 



exclusively in the time-domain. 

However, the v values are only known indirectly through the differences v (t + 1) — v(t). Define 
at = v{t) — z^(0) and observe that at is known via the telescoping summation v(t) = i^(0) + 
^2lZo(^(i + 1) — v(i)). Since the Ornstein-Uhlenbeck process has no drift, S x S xy = S y S xx , where 
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Figure 3: Estimate f versus its underlying value r. For each value of r, 30 Monte Carlo simulations 
were executed over intervals of length n = 25000. 



s x = ELi 1 "(* - l ) and S v = E*=l 



n-l 



V\l\ 



|van den Berg, 2007] , Therefore, 



n-l 



n-l 



n-l 



n-l 



= ^(0) + a i -i)^K0) + a J _ 1 )(K0) + a i )-^(K0) + «0EK°) + a ^ 
i=i j=i i=i j=i 

n—1 n—1 
i=l 3=1 
n—1 n—1 

YjYj ^(°) 3 + ^(°) 2 ( 2a i-i + a i) + K0)(af_i + 2a< i a,_i) + a i a^_ 1 
i=l j=i 

= (n - l)zv(0) + ^(0)^ + A x A xy - (n - l)u(Q)A xx - u(Q)A x A y - A y A xx , 



where A x = YJl=i A y = E"=i Ay = XXi a i a i-i, and Ay = EiLi a * a ^ Solving for 

z^(0) now gives 



1/(0) 



(n l)A X y (n Y)A XX + j4 2 ^4yj4 x 

Given the estimate for z^(0) and the ctj's, the i^(i)'s can be estimated, and thus r and a 2 . 

To increase the estimate accuracy in the presence of an underlying deterministic trend £, we 
estimate a linear fit to the log-prices p and subtract it from p(t). 

Monte Carlo simulations were conducted to ascertain the accuracy of the maximum likelihood 
estimation. The estimation was quite accurate when the underlying LPPL trend gave negligible 
contributions to the a«'s, but less accurate otherwise. Additionally, even in the complete absence of 
an underlying trend, the estimate f of r became progressively less accurate as r gets larger (Figure 
[3]). An intuitive explanation is that when r is large, then mean reversion affects only slightly the 
aj's, making it hard to obtain an accurate fix on r. In principle, the problem could be obviated by 
formulating an estimate with returns over longer periods of time (i.e., v{i) = v(ki), k > 1). However, 
the problem is compounded if an underlying trend I has relatively large power at frequencies smaller 
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than the critical frequency f c = 1/(2ttt). In this case, the underlying trend I affects the signal at 
the same frequencies at which the relaxation term does, thus obscuring the exact contribution of 
the relaxation constant. The case when r is large will be addressed by pessimistic estimation. 



3.4 Pessimistic Estimation 

In pessimistic estimation, we assume that the noise is generated by a Weiner process (i.e., r — > oo) 
and estimate a using the constraint \P\ 2 = \L\ 2 + S > S that the noise power should not exceed 
the observed signal power. The estimate is pessimistic in that it assumes no mean reversion and 
thus strong noise even at low frequencies. 

Let S T (f) be the power spectrum of an Ornstein-Uhlenbeck process when the relaxation constant 
is r and define 5oo(/) = hnV-s-oo S T (f). Then, if / > 0, 

2 2 

SooU) = lim S T (f) = — ° - ^ lim r(l- e' 2 ^ 



and 



4(1 - cos(2vr/)) r^oo V J 2(1 - cos(2vr/)) ' 



Soo(0) = hm — = a 

r^oo 2 (1 — a) z 



It should be the case that P(f) < £oo(/) for all /'s. In practice, however, the observed signal is the 
realization of a stochastic signal, and so P(f) may or may not exceed 5 I 00 (/) |Loeve, 1978| . Hence, 
we only impose integral constraints of the form 



rf+ rf + 
J SUf)df< J P(f)df, 



where / and f + are parameters to be determined with < / </ + <l/2. Furthermore, the 
spectrum P is calculated only at the discrete points fi = i/n, so the constraint becomes 

k k 



i=h i=h 



which then leads to 



a 2 < - ^ i=h (3) 
" Eth V(l " cos(2vr/,)) ' 

A pessimistic estimate can be obtained by calculating the bounds for ho = 1, kj = faj+i = (l + a)hj 
(for some constant a > 0, e.g., a = 1) and then taking the most conservative bound. 

The numerical calculation of the bounds is complicated by the fact that the summations in Q 
involve terms whose value can differ by orders of magnitude. In this case, if the largest terms are 
added first, due to the finite representation precision, the smallest terms are likely to be truncated. 
In an extreme scenario, many small terms could collectively dominate the value of the summation 
but since they are added individually to a larger partial sum, their contribution would be lost. 
In general, a summation is numerically more accurate when it always adds terms of comparable 
magnitude. Since Soo is a decreasing function (and the same holds in the expectation for P), the 
numerical calculation should always start from the largest frequency fk and proceed backward to 
fh- (As an aside, however, the numerical calculation is only needed for the numerator, since the 
denominator could be replaced by an integral that is solvable analytically.) 
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Figure 4: DFT amplitude of a log-periodic function, (A = W,B = 0.008, T = 26000, m = 0.7, n = 
25000, C = 0.4, u = 2vr, $ = vr), underlying Ornstein-Uhlenbeck noise (a 2 = .000015, r = 2000, / c = 
7.96 • 10~ 5 ), and pessimistic estimate (a = 1, a 2 = .0000145). 

Figure [4] shows an example of pessimistic estimate in a case when r = 2000 is relatively large 
and difficult to estimate because P(f c ) is dominated by the power of the underlying signal £. The 
pessimistic estimate was quite accurate, and Soo differs from the underlying S(f) only for the 
smallest frequency values. Similar conclusions were supported by several additional Monte Carlo 
simulations. 



4 Reflection 

The Ornstein-Uhlenbeck process describes an infinitely long signal. On the contrary, p(0),p(l), . . . ,p(n— 
1) is a finite sequence. Similarly, £ is defined in the finite interval [0, T]. In the calculation of the 
spectrum, an ambiguity arises regarding the behavior of p and £ outside of their definition interval. 
In many applications, finite sequences are multiplied by a window function, or they are implicitly 
assumed to be periodic. Implicit periodization matches directly the discrete Fourier transform 
(DFT), in the sense that, given the sequence p(0),p(l), . . . ,p(n — 1), the DFT assumes that the 
signal is infinite, periodic, with period n, and that p(i) = p(i — n) for i = 0, ±1, ±2, .... In typical 
log-periodic sequences, p(n — 1) 3> p(0), and if the signal were viewed as periodic, then there would 
be a large step between p(n — 1) and p(n) = p(0). The step is primarily an artifact of the implicit 
DFT assumption of periodicity, but the large artificial step could dominate the behavior of the 
power spectrum. As for windowing, typical window functions either leave a large boundary step 
(e.g., rectangular window) or disregard the fact that the LPPL behavior becomes more pronounced 
at the boundaries of the observation window (e.g., Hann). 

In this paper, the discontinuity is obviated by reflection: given a sequence p(0),p(l), . . . ,p(n— 1), 
a new sequence is constructed by juxtaposing the original sequence and a reverse version of the 
same sequence: p{n — 1), . . . , p(l) , p(0) , p(l) , . . . ,p(n — 2), and assuming that the new sequence is 
periodic with period 2(n — 1). The reflected sequence has no abrupt discontinuity between the 
first and last element, and thus no such step is visible in its spectrum. We also tried alternative 
approaches, such as appending after p(n — 1) values that smoothly interpolate between p(n — 1) and 
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Figure 5: DFT amplitude of a realization (a = .2, r = 5) of the Ornstein-Uhlenbeck process, of its 
reflection, and ^S(f). 

p(0) over a long time frame, but we did not find significant differences between these alternatives 
and reflection. 

To reiterate, given a finite sequence or a function defined over a finite interval, the Fourier 
transform always requires an assumption of some sort on the sequence behavior outside the given 
interval. For example, if the sequence is left unchanged, the DFT implicitly assumes that the 
sequence is periodic. In this light, reflection is a natural choice because, unlike implicit periodization 
or windowing, it eliminates abrupt discontinuities at the boundaries. Reflection also lead to a 
symmetrical analysis of bubbles and anti-bubbles (i.e., a bubble- like behavior in reverse with rapidly 
decreasing prices |Sornette, 2004| ). 

If reflection is applied to a sequence p = i + v that is the sum of a log-periodic component 
and a noise component, reflection will apply indiscriminately to both components. Thus, it is 
possible in principle that reflection would alter the power spectrum of noise. However, several 
Monte Carlo simulations showed that reflection leaves the power spectrum of Ornstein-Uhlenbeck 
noise practically unaffected. For example, Figure [5] gives the DFT amplitude of a realization of an 
Ornstein-Uhlenbeck process, the DFT amplitude of the reflection of the same process, and \J S(f). 
Reflection leaves the same general spectral behavior because, intuitively, the autocorrelation of 
stochastic signals is invariant to time reversal and the autocorrelation of an Ornstein-Uhlenbeck 
process decays exponentially. 

5 Log-Periodic Spectra 

To derive the LPPL spectrum, we will break down the LPPL model into its two main components of 
power law (without oscillations) and log-periodicity (without super-exponential growth). Then, we 
will return to the general case with the insight gained from the special cases, and verify numerically 
its spectral behavior. 
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Figure 6: DFT amplitude of the power law £ m . 

5.1 Power Law 

Consider first the case when C = 0, i.e., the LPPL function is completely determined by its power 
law behavior. If m = C = (or if B = 0), t reduces to a constant, and its transform L{f) = for 
/ 7= 0. If C = 0,m = 1, the reflected LPPL reduces to a triangular wave, for which it is known 
that \L(fi)\ oc 1/fi when i is odd and L(fi) = when i > is even. 

The super-exponential behavior is the most pronounced when m — > + , and A, B change as a 
function of m so that £ is not a constant. First, suppose for the time being that T = n (the same 
result will hold for T > n except for changes in the normalization constants). If A is multiplied by 
a factor independent of t, L( f) remains unchanged (/ 7^ 0). Similarly, if B is multiplied by a factor 
independent of t, L(f) is multiplied by the same factor (/ 7^ 0). In other words, a normalization of 
the constants A and B renormalizes L(f) but does not alter its qualitative behavior. Assume that 
A and B are renormalized so that £(0) = and J Q T £(t)dt = 1/2. Thus, A = A(m) = (l + l/m)/(2T) 
and B = B(m) = A/T m . Let £ m (t) = A(m) - B(m)(T - t) m . Note that lim m ^ + A(m) = 00 and 
that we take the transform of reflected signals. Hence, lim m _ s>0 + &m(t) is t ne delta function, and its 
spectrum is a constant (specifically, 1 /2T with the common conventions on the DFT normalization 
factor). Figure [6] depicts the convergence of £ m to the delta function in the frequency domain. 
When to 7^ is small, a flat spectrum characterizes the higher frequencies. As m — > + , a constant 
spectrum is found in a progressively larger frequency interval. Meanwhile, the spectrum at low 
frequencies has an increasingly flatter slope: \L(f)\ cx l// 2 at m = 1, \L(f)\ oc 1/f at m ~ 0.1, 
and so on. The amplitude \L(f)\ decreases faster than 1/f for the range m > 0.1 that defines the 
"stylized features of LPPL" |Lin et al., 2009| . 

The same behavior holds also when n < T by appropriately scaling the normalization constants 
of A and B. The same results hold qualitatively for A, B constant: the spectrum is flat although 
the absolute values do change depending on the normalization factor (see, for example, Figure [7]). 

5.2 Log-Periodicity 

Ifm = 0, then £(t) = A — B(l + C cos(ui ln(T — t) + 4>)) (see Figure [8] for an example). By discounting 
the constant terms, the resulting signal is £{t) = cos(wln(T — t) + (f>). The signal £(t) includes a 
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Figure 7: DFT amplitude of an LPPL function for various values of m (A = 10, B = 0.01, T = n = 
25000, C = 0). 




Figure 8: An LPPL function that highlights the oscillatory term as a function of non-linear time 
scaling (A = 1, B = 1, C = -1, m = 0, u = 3tt, n = 25000, T = n/(l- e - ll7r / w ), </> = -wln(T-n)). 
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Figure 9: The DFT amplitude of the LPPL function in Figure [HJ with arrows pointing to the 
minimum and maximum frequencies of the log-periodic spectrum. 

non-linear time scaling, which can be interpreted as the frequency modulation of a carrier signal 
sin(27r f(t)t + a) with some underlying signal f(t). Given a frequency modulated signal, such as 
i(t), its power spectrum resides almost entirely in the band between the maximum and minimum 
value of the modulating signal |Carson, 1922| . In practice, the differential frequency at time t is 
given by the derivative of phase uj ln(T — t) + <p normalized by 2tt, and is thus equal to (jj/(2ir(T—t)). 
Hence, the minimum frequency is uj/(2ttT) and the maximum frequency is u}/(2tt(T — n)). Figure 
[9] shows an example along with the predicted frequency bounds. 

Frequency- modulated signals are known to be resilient to changes in signal amplitude. In 
particular, the spectrum of £ m (t) = (T — t) m cos(cj ln(T — t) + <p) should be qualitatively close 
to the spectrum of £o(t). For example, Figure 
now m = 0.3. The maximum and minimum frequencies still delimit the area where the frequency 
modulated signal has predominant power. 

Incidentally, the critical time T is in a special position in that it affects both power law (due to 
(T — t) m term) and log-periodicity (due to the ln(T — t) term). Correspondingly, T determines both 
the maximum frequency uj/(2ir(T—n)) in the frequency modulated spectrum and the normalization 
constants A(m),B(m) in the power law spectrum. In both cases, the effect of T is similar in that, 
when T approaches n, the maximum frequency and the normalization constants both increase. 

Frequency modulation analysis could be regarded as the dual of the Lomb transform of the de- 
trended signal | Jiang et al., 20 10] in that the frequency bounds are useful to estimate log-periodicity, 
whereas Lomb analysis is useful to confirm it after the LPPL parameters have already been esti- 
mated. 

5.3 Combined LPPL 

The two LPPL hallmarks are power law and log-periodicity. Each translates directly into the 
frequency domain. The power law implies a flat spectrum at high frequencies and moderate slope 
at low frequencies. Log-periodicity implies a bounded spectrum similar to that of a frequency 
modulated signal. Given the spectrum |P| 2 of prices during a bubble, we would expect to find 
either (or both) signatures of LPPL in the frequency domain. 




10 shows the spectrum of Figure M except that 
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Figure 10: The DFT amplitude of the LPPL function in Figure [8] but with m = 0.3, with arrows 
pointing to the minimum and maximum frequencies of the log-periodic spectrum. 



The general LPPL spectrum is analytically intractable, and it was estimated numerically. Se- 
quences were generated for hundreds of different LPPL parameter sets, the respective spectra 
were calculated numerically and plotted. In general, to make sense of the spectrum, it is helpful 
to interpret it qualitatively in terms of the two main features of power law and log-periodicity. 
Specifically, a LPPL spectrum can be thought as the superposition of a power law spectrum and 
a log-periodic spectrum, where the superposition is weighted by the parameter C. For example, 
Figure [TU] compares an LPPL spectrum with that of a pure power law with the same parameter 
values (but C = 0). As another example, Figure [IT] shows the spectrum for a pure power law func- 
tion (m = 0.7, C = 0), a pure log-periodic function (m = 0, C = 0.5), and two intermediate cases 
(m = 0.7, C = 0.01,0.05). The intermediate cases have a spectrum that is visually the superposi- 
tion of the two extreme spectra. Furthermore, higher values of C make the log-periodic component 
more visible. If C is small, the frequency modulation lobes are typically visible around the trend 
rather than above it (e.g., Figure 12). Results were similar for all other combinations of parameters, 
and omitted. Although it is helpful to comprehend a general LPPL spectrum as a superposition 
of feature, the intuition can seldom be translated into a closed expression. However, it is always 
useful to think the LPPL spectrum as the combination of two broad features. In particular, given 
a noisy LPPL, we would expect to find the two LPPL signatures in the frequency domain. 



6 De-Noising 

We now turn to discuss the extent to which it is possible to extract an underlying LPPL signal 
from noisy price measurements. The expectation would intuitively be that the mean-reverting 
noise smooths out relatively quickly so that the underlying LPPL behavior should be visible at the 
lower frequencies. More precisely, the potential for de-noising depends on achieving high values 
of the signal-to-noise ratio R(f) = \L(f)\ 2 /S(f). The signal-to-noise ratio R(f) is related to the 
non-causal Weiner filter K{f) = 1/(1 + 1/R(f)). The Weiner filter K has the property that the 
filtered signal £{i) = Yl'jL-oo k{j)p{i — j) minimizes the mean square error ^2(£(i) — i{i)) 2 among 
all linear filters, where the fe's are the inverse transform of K and p is the reflected and periodicized 
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Figure 11: \L(f)\ for A = 100, B = 0.01, T = 26000, n = 25000, u = 2tt,c/> = in the cases of pure 
power law (m = 0.7, C = 0), pure log-periodicity (m = 0, C = 0.5), and two intermediate cases 
(ro = 0.7, C = 0.01,0.5). 




Figure 12: |L(/)| for yl = 100,5 = 0.01, T = 26000, n = 25000, w = 2vr,(> = in the cases of 
pure power law (m = 0.7, C = 0), pure log-periodicity (m = 0, C = 0.05), and combined case 
(m = 0.7, C = 0.05). 
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Figure 13: Spectrum \L(f)\ of £q.i with and without noise, and pessimistic noise estimate. 



time series of prices. If R(f) decreases with /, then K (/) is a low pass filter and, intuitively, the 
filter replace each price p(i) with a smoothed combination of its neighbors so as to reject the noise. 
The signal-to-noise ratio is a function of frequency and can take various shapes depending on the 
parameters of the underlying LPPL £ and Ornstein-Uhlenbeck noise. 

In the stylized LPPL, m > 0.1, and, with a pure power law (C = 0), \L\ 2 always decreases 
faster than the slope of S. Hence, the power law contributes to de-noising only if \L(f)\ 2 > S(f) 
at low frequencies. In pure log-periodicity (m = 0), |£(/)| is significant only for frequencies 
/ < uj/(2tt(T — n)). Again, log-periodicity contributes to de-noising only if \L(f)\ 2 > S(f) at low 
frequencies. 

It is useful to examine the special case when oc 1// at low frequencies since |L|'s slope 

matches exactly the slope of Soq. In this case, it may be hard to ascertain the presence of a signal 
£ if Weiner noise is also present since the LPPL spectrum almost perfectly overlaps with the noise 
spectrum. Figure 13 shows the amplitude \L\ of an LPPL ^o.i without noise. Then, Gaussian white 
noise was generated with variance a 2 chosen so that the corresponding spectrum Soc matches closely 
\L\ 2 at low frequencies. The amplitude of the resulting price transform is shown in Figure 13 along 



with the pessimistic estimate defined in Section 3.4 The pessimistic estimate overlapped almost 



exactly the true noise spectrum (whereas the maximum likelihood estimate did not produce finite 
parameter estimates). The spectra \L\ 2 , \P\ 2 , and 5^ were practically identical at low frequencies, 
but at high frequencies |P| followed the larger \L\. We conclude that even in the special case when 
the LPPL is hidden under the noise because m makes \L(f)\ oc 1/f and a 2 makes \L(f)\ 2 ~ Soo at 
low frequencies, LPPL and noise can be distinguished by extracting a pessimistic noise estimate. 
However, in this case, the difference is noticeable at high frequencies. 

In summary, the intuition was that LPPL should be visible at the low frequencies, and it is 
correct in most cases. Then, de-noising should be possible when the spectrum looks qualitatively 
as in Figure [4j with the price spectrum clearly above the noise estimate for a significant range of 
frequencies at the low end of the spectrum. However, we found special combinations of parameters 
(e.g., Figure 13) where the presence of LPPL is visible only from the highest frequencies. 

If the time horizon n approaches the critical time T, intuition would suggest that it should 
be easier to detect an LPPL trend. Indeed, if the critical time T is approaching, then the max- 



15 



Series 


Period 


Data Points 


Dow Jones Industrial Average 


June 1921-July 1929 


2440 


S&P 500 


July 1985-July 1987 


527 


NASDAQ Composite 


January 1994-February 2000 


1555 


S&P 500 


July 2003-June 2007 


1000 


GLD 


March 2009-October 2009 


171 



Table 1: Price time series used in the evaluation. 



imum log-periodic frequency is higher resulting into a wider frequency modulated spectrum, and 
the normalization constant B is larger, shifting the spectrum upward. In other words, when the 
critical time approaches, the LPPL function resembles more closely an impulse and additionally its 
oscillations are wilder, so that it is hard for mean-reverting noise to disguise the underlying LPPL 
trend. 



7 Evaluation 

Data sets are daily closing values of the major indexes and securities shown in Table [TJ The first 
four data sets are associated with major historical bubbles in the U.S. stock market. The last data 
set is a recent bubble in gold prices that burst in November 2009 |Sornette et al., 2009| . These 
prices sequences stop closely before the time at which the price reached its maximum level during 
the bubble episode. Therefore, the detection of an underlying LPPL trend should be relatively 
easy. We have additionally considered individual stocks. For example, we have investigated various 
tech stocks during the 1998-2000 bubble and the Netflix stock in the 2005-10 period. The results 
are qualitatively similar to those reported here, and omitted. 

The maximum likelihood and pessimistic noise estimates were close to each other, providing 
evidence that mean reversion is weak. Both estimates fit well the price spectrum, a sign that 
prices can be explained primarily as a Weiner process. In most cases, the spectrum deviates from 
the pessimistic estimate only at / = 0, l/(2n), which is consistent with adding Weiner noise to 
deterministic exponential price trajectory. 

As for the maximum likelihood estimate, the diffusion constant is relatively large. The maximum 
likelihood estimate was slightly but consistently smaller at low frequencies than the price spectrum 
in two cases: Dow Jones 1929 and gold 2009. The discrepancy was investigated with a filter to 
remove the maximum likelihood noise. The filter is non-causal and produces a signal I with the 
property that L(f) = L(f) if / < / and L(f) = otherwise, where / is the smallest frequency 
/ at which |L(/)| 2 < S(f). The intuition is that the underlying LPPL spectrum \L\ 2 decreases 
faster than the noise spectrum S, so if one takes the smallest frequency / at which |L(/)| 2 > S(f), 



the resulting low-pass filter approximates a Weiner filter. Figures |19| and 20 show the original and 
filtered series. Both filtered series show significant oscillations at the beginning and slight super- 
exponential growth throughout. However, the oscillations are absent toward the end of the filtered 
sequence. Since log-periodic oscillations become progressively more rapid toward the critical time, 
even if log-periodicity were present in these price sequences, oscillations would be blocked by the 
filter at the highest log-periodic frequencies. However, the filter only blocks frequencies when noise 
dominate the signal, and so we conclude that log-periodicity, if at all present, has been disrupted by 
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Figure 14: Spectrum of the Dow Jones 1929 price sequence. 
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Figure 15: Spectrum of the S&P 500 1987 price sequence. 

noise. Similarly, super-exponential growth is visually unclear both in the time and in the frequency 
domain. 

In summary, noise had at best weak mean reversion and relatively high variance, so that, even 
if LPPL underlied price dynamics, it was obscured by noise. 

8 Conclusions 

The estimators show that mean reversion is weak, and Ornstein-Uhlenbeck noise is close to a 
non-mean-reverting Weiner process. Furthermore, the signal-to-noise ratio R(f) is low, and it 
mostly makes it possible to reconstruct an underlying exponential trend. Even in those cases 
where R(f) > for a range of low frequencies, noise makes it impossible to reconstruct either 
log-periodicity or a power law. In short, due to noise, there is no trace of LPPL during bubbles. 

However, it is possible in principle that LPPL underlies price dynamics, but that it cannot 
be isolated with pure frequency methods. Future work will investigate different transforms, such 
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Figure 16: Spectrum of the NASDAQ Composite 1994-2000 price sequence. 
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Figure 17: Spectrum of the S&P 500 2003-07 price sequence. 
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Figure 18: Spectrum of the GLD (gold) 2009 price sequence. 
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Figure 19: Dow Jones 1929 with filtered price sequence (/ = /g). 
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Figure 20: Gold 2009 with filtered price sequence (/ = fe). 
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as wavelets, that may make it possible to discern explosive bubble growth. Furthermore, if the 
underlying LPPL were expressed as a dynamic system with known parameters, it would be possible 
to use the additional information in de-noising filters that extend a pure frequency approach. 
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